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Abstract 

In this paper we generalize iV-fold integer programs and two-stage integer programs with 
N scenarios to iV-fold 4-block decomposable integer programs. We show that for fixed blocks 
but variable N, these integer programs are polynomial-time solvable for any linear objective. 
Moreover, we present a polynomial-time computable optimality certificate for the case of 
fixed blocks, variable N and any convex separable objective function. We conclude with two 
sample applications, stochastic integer programs with second-order dominance constraints and 
stochastic integer multi-commodity flows, which (for fixed blocks) can be solved in polynomial 
time in the number of scenarios and commodities and in the binary encoding length of the 
input data. In the proof of our main theorem we combine several non-trivial constructions 
from the theory of Graver bases. We are confident that our approach paves the way for further 
extensions. 



1 Introduction 

Let A £ Z dx " be a matrix. We associate with A a finite set G{A) of vectors with remarkable 
properties. Consider the set ker(j4)nZ ra . Then we put into G(A) all nonzero vectors v £ ker(A)nZ n 
that cannot be written as a sum v = v' + v" of nonzero vectors v', v" £ ker(A) n Z" that lie in the 
same orthant (or equivalcntly, have the same sign pattern in {> 0, < 0} n ) as v. The set Q(A) has 
been named the Graver basis of A, since Graver [6] introduced this set Q{A) in 1975 and showed 
that it constitutes an optimality certificate for a whole family of integer linear programs that share 
the same problem matrix, A. By this we mean, that Q{A) provides an augmenting vector/step to 
any non-optimal feasible solution and hence allows the design of a simple augmentation algorithm 
to solve the integer linear program. 

In the last 10 years, a tremendous theoretical progress has been made in the theory of Graver bases. 
It has been shown that G{A) constitutes an optimality certificate for a much wider class of integer 
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minimization problems, namely for those minimizing a concave or a separable convex objective 
function over {z : Az = b, 1 < z < u, z G Z™} [2j[TTl[T3]. Moreover, it has been shown that only 
polynomially many Graver basis augmentation steps are needed to find a feasible solution and to 
turn it into an optimal feasible solution [JJ [FJ [T5] . Finally, based on the fundamental finiteness 
results for certain highly structured matrices A (TV-fold IPs and two- and multi-stage stochastic 
IPs) [TJ 03 El [H] , it has been shown that concave and separable convex TV-fold IPs and two- and 
multi-stage stochastic IPs can be solved in polynomial time [3l[8] for fixed blocks. 

In this paper, we will combine the two cases of TV-fold IPs and of two-stage stochastic IPs by 
considering problems with a problem matrix that is TV-fold 4-block decomposable as follows: 



C D\( N ) 
.B A) 



( C D D 
B A 
BOA 

V B 



D \ 



A J 



for some given TV G Z + and TV copies of A. We call ( ^ 2 ) an -^-fold 4-block matrix. For B = 
and C = we recover the problem matrix of an TV-fold IP and for C = and D = Owe recover 
the problem matrix of a two-stage stochastic IP. 



Note that TV-fold 4-block decomposable matrices also arise in the context of combinatorial op- 
timization [Tni [TTJ . More precisely, for totally unimodular matrices C, A their 1-sum is totally 
unimodular (B = 0, D = 0). Similarly, total unimodularity is preserved under the 2-sum and 3- 
sum composition. Indeed, it can be verified that a repeated application of specialized 1-sum, 2-sum 
and 3-sum compositions leads to a particular family of TV-fold 4-block decomposable matrices with 
structure regarding the matrices B and D. 

Example. For matrices C and A, column vector a and row vector b T of appropriate dimensions, 



the 2-sum of ( C a ) and ( ) gives ( ^ a ^ T ) . The 2-sum of 



C ab T ab T 
A 
A 



C ab T 
A 



which is the 2-fold 4-block decomposable matrix 



' C ab T 
, A 



and(^ 

(2) 



creates the matrix 
□ 



Our main result is the following. 



Theorem 1 Let A G Z dAXriA , B G Z dAXnB , C G Z dcX7lB , D G Z dcXnA be fixed matrices. For 
given TV G Z + let 1, u G Z nB+NnA , b G Z dc+NdA , and let f : R™b+Nu a r j e a separable 
convex function and denote by f the maximum of \ f\ over the feasible region of the convex integer 
minimization problem 

MI'iv ,,! ,,/ : min {/(z) : ( § % ) W z - b, 1 < z < u, z G Z nB+NnA } . 

We assume that f is given only by a comparison oracle that, when queried on z and z' decides 
whether f(z) < f(z'), f(z) = f(z') or f(z) > f(z'). Then the following hold: 



(a) There exists an algorithm that computes a feasible solution to (IP)Ar,b.i,u./ or decides that no 
such solution exists and that runs in time polynomial in TV, in the binary encoding lengths 
(l,u,b). 
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(b) Given a feasible solution zq to (IP)Ar,b,i,u,/, there exists an algorithm that decides whether Zq 
is optimal or finds a better feasible solution Z\ to (IP)jv,b,i,u,/ with /(zi) < /(zo) and that 
runs in time polynomial in N, in the binary encoding lengths (1, u, b, /), and in the number 
of calls to the evaluation oracle for f . 

( c ) V f * s linear, there exists an algorithm that finds an optimal solution to (IP)jv,b.i,u./ or 
decides that (lP)N,b.i,u.f is infeasible or unbounded and that runs in time polynomial in N, 
in the binary encoding lengths (1, u,b, /}, and in the number of calls to the evaluation oracle 
for f. 



This theorem generalizes a similar statement for TV-fold integer programming and for two-stage 
stochastic integer programming. In these two special cases, one can even prove claim (c) of The- 
orem Q] for all separable convex functions and for a certain class of separable convex functions, 
respectively. It is a fundamental open question, whether one can construct not only some aug- 
menting vector for a given separable convex objective function / in polynomially many steps but 
a best-improvement (or greedy) augmentation step av with a G Z + and v G Q ^( ^ ^ ■ If this 

can be done, part (c) of Theorem [1] can be extended from linear / to a class of separable convex 
functions / by applying the main result from [8]. 



In fact, Theorem Q] will be a consequence of the following structural result about Q f(g 5) 



(AT 



Theorem 2 If A G Z dAXnA , B G Z dAXriB , C G Z dcXnB , D G 7L dcXnA are fixed matrices, then 



:{lM| 



C D\( N ) 



^ | is bounded by a polynomial in N. 



In the next section, we present two applications of Theorem [TJ stochastic integer programming 
with second-order dominance constraints and stochastic integer multi-commodity flows. While the 
first application has an iV-fold 4-block matrix as problem matrix, the second application can be 
modeled as an iV-fold 4-block IP after a suitable transformation. To state the result, we introduce 
the following type of matrices. For given N G Z + let 

(A B ■■■ B \ 



' A B|W ._ 
-DCi ■— 



D 



B 

A B 
D C 



B 



\D ■■■ D C J 

where we have N copies of A and of C . Then the following holds. 



Corollary 3 Let A G Z dAXnA , B G Z dAX7lB , C G Z dcXnB , D G Z dcXnA be fixed matrices. For 
given N G Z + let 1, u G Z N ^ nA+nB \ b G Z N( - dA+dc \ and let f : R N ( n A+n B ) f j e fl separable 
convex function and denote by f the maximum of \ f\ over the feasible region of the convex integer 
minimization problem 



(IP)iV,b,l,uJ 



■{/(« 



■A BlW._ 

-DCi z ~ 



b,l < z < u,z G Z N{nA+nB ^ 
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We assume that f is given only by a comparison oracle that, when queried on z and z' decides 
whether /(z) < f(z'), f(z) = f(z') or f(z) > f(z'). Then the following hold: 

(a) There exists an algorithm that computes a feasible solution to (IP)' N b 1 u / or decides that no 
such solution exists and that runs in time polynomial in N , in the binary encoding lengths 
(l,u,b). 

(b) Given a feasible solution Zo to (IP)^y b l u / > there exists an algorithm that decides whether Zq 
is optimal or finds a better feasible solution z\ to (IP)jvbiu/ with f(z\) < /(zo) and that 
runs in time polynomial in N, in the binary encoding lengths (1, u, b, /), and in the number 
of calls to the evaluation oracle for f . 

(c) If f is linear, there exists an algorithm that finds an optimal solution to (IP)jy b l u / or 
decides that (IP)^r b l u / * s infeasible or unbounded and that runs in time polynomial in N , 
in the binary encoding lengths (1, u, b, /}, and in the number of calls to the evaluation oracle 
for f. 

We do now present problems to which Theorem [T] and its Corollary [3] apply. Thereafter, we prove 
our claims. Our proof of Theorem [1] combines several non-trivial constructions from the theory of 
Graver bases. We are confident that our approach paves the way for further extensions. 



2 Applications 

In this section we present two iV-fold 4-block decomposable integer programming problems that 
are polynomial-time solvable for given fixed blocks and variable N by Theorem [I] and its Corollary 

m 

2.1 Stochastic integer multi-commodity flow 

Let there be M integer (in contrast to continuous) commodities to be transported over a given 
network. While we assume that supply and demands are deterministic, we assume that the upper 
bounds for the capacities per edge are uncertain and given initially only via some probability 
distribution. The problem setup is as follows: first, we have to decide how to transport the M 
commodities over the given network without knowing the true capacities per edge. Then, after 
observing the true capacities per edge, penalties have to be paid if the capacity is exceeded. 
Assuming that we have knowledge about the probability distributions of the uncertain upper 
bounds, we wish to minimize the costs for the integer multi-commodity flow plus the expected 
penalties to be paid for exceeding capacities. To solve this problem, we discretizc as usual the 
probability distribution for the uncertain upper bounds into N scenarios. Doing so, we obtain a 
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(typically large-scale) (two-stage stochastic) integer programming problem with problem matrix 

I A ■ ■ ■ \ 

A ••• 

I ■■■ I I -I 

V j ... i i i ) 

Herein, A is the node-edge incidence matrix of the given network, / is an identity matrix of 
appropriate size, and the columns containing —I correspond to the penalty variables. If the network 

is kept fix, A, I, and —I arc fix, too. As the problem matrix is simply [ "/ ( j -j) ] \ we can a PPly 
Corollary [3] and obtain the following. 

Theorem 4 For given fixed network the two-stage stochastic integer linear multi- commodity flow 
problem is solvable in polynomial time in the number M of commodities, in the number N of 
scenarios, and in the encoding lengths of the input data. 

Proof. The only issue that prevents us to apply Corollary [3] directly is the fact that M and N 
arc different. But by introducing additional commodities or scenarios, we can easily obtain an 
equivalent (bigger) problem with M = N for which we can apply Corollary [3J If M < N, we 
introduce additional commodities with zero flow and if M > N, we take one scenario, copy it 
additional M — N times and choose for each of these M — N + 1 identical scenarios 1/(M — N + 1) 
times the original cost vector. So, in total, these M — N + 1 scenarios are equivalent to the one we 
started from. □ 

It should be noted that we can extend the problem and still get the same polynomiality result. 
For example, we may assume that we are allowed to change the routing of the M commodities in 
the second-stage decision. Penalties could be enforced for the amount of change of the first-stage 
decision or only for the amount of additional flow on edges compared to the first-stage decision. 
Writing down the constraints and introducing suitable additional variables with zero lower and 
upper bounds, one obtains again a problem matrix that allows the application of Corollary [3j 



2.2 Stochastic integer programs with second-order dominance constraints 

Stochastic integer programs with second-order dominance constraints were introduced in [5] . Therein, 
in Proposition 3.1, the following mixed- integer linear program was obtained as a deterministic 
equivalent to solve the stochastic problem at hand. We refer the reader to [5] for the details. 

cT x + qTy (fe -a fc < v ifc VZVfc 
Tx + Wy lk = Zf VA/fc 

x e X,y lk £ Z™ x Rip', vjfc > VZVfc 

We assume now that all variables are integral and, for simplicity of exposition, we assume that the 
inequalities of the polyhedron X are incorporated into the constraints Tx + Wy lk = zj. Moreover, 
we assume that all scenarios have the same probability, that is, 7r; = l/L, I = 1, . . . , L. 



(SIP) : min • 



5 



Theorem 5 For given fixed matrices T and W and for fixed number K , "problem (SIP) is solvable 
in polynomial time in the number L of (data) scenarios, and in the encoding lengths of the input 
data. 



Proof. Wc transform the problem in such a way that Theorem [T] can be applied. First, we include 
the constraints c T x + q T y/j. — < ~vik into the constraint Tx + Wy lk = z/ (by adding slack 

- f T \ - ( W \ 

variables to get an equation). Then, we set T = : and W = I ■. , in which we use K 

\fj \ ' w J 

copies of T and W, respectively. As T, W, and K are assumed to be fixed, so are T and W . With 
this, the problem matrix now becomes 



/ I 

T W 



1 1 \ 




\T WO/ 

Introducing suitable additional variables with zero lower and upper bounds, we obtain a problem 
matrix of the form ( § ^ ^ with A = ( w o ), B = T, C = 0, and D = (i i). Thus, we can apply 
Theorem [T] and the result follows. □ 



3 Proof of main results 

For a concise introduction to Graver bases (and to the results on TV-fold IPs), including short 
proofs to the main results, we refer the reader to the survey paper by Onn [12j . In this section, 
we state and prove results on Graver bases needed for the proof of our main theorem in the next 
section. Let us start by bounding the 1-norm of Graver basis elements of matrices with only one 
row. This lemma is a straight-forward consequence of Theorem 2 in [3]. 

Lemma 6 Let A £ Z lx ™ be a matrix consisting of only one row and let M be an upper bound on 
the absolute values of the entries of A. Then max{||v||i : v £ G(A)} < 2M — 1. 

Let us now prove some more general degree bounds on Graver bases that we will use in the proof 
of the main theorem below. 

Lemma 7 Let A £ Z dxn and let B £ 1 mxn . Moreover, put C :=(£). Then we have 

maxOvIl! : v £ G(C)} < nu«{||A||i : A £ Q(B ■ Q{A))} ■ max{||v|| 1 : v £ G(A)}. 

Proof. Let v £ G(C). Then v £ ker(^4) implies that v can be written as a nonnegative integer linear 
sign-compatible sum v = ^ \Si using Graver basis vectors £ G(A). Adding zero components 
if necessary, we can write v = G(A)X. We now claim that v £ G(C) implies A £ G(B ■ G(A)) and 
the result follows. 



G 



First, observe that v £ kcr(B) implies Bw = B ■ (G(A)X) = (B ■ Q(A))\ = and thus, A £ 
ker(i? • Q(A)). If A g" Q(B ■ Q(A)), then it can be written as a sign-compatible sum A = \i + v with 
/x, v £ kcr(B • Q{A)). But then 

v = (g(A)») + (g(A)u) 

gives a sign-compatible decomposition of v into two vectors Q(A)fi, Q(A)u £ ker(C), contradicting 
the minimality property of v £ Q{C). Hence, A £ Q(B ■ 0(A)) and the result follows. □ 

We will employ the following simple corollary. 

Corollary 8 Let A £ Z dx " and let a J £ Z" be a row vector. Moreover, put C := (-£). T/ierc we 
have 

max{||v||i : v £ 0(C)} < (2 • max{|a T v| : v £ G(A)} - 1) • max{||v||i : v £ G(A)}. 
In particular, if M := max{|a^' | : i = 1, . . . ,n} then 

max{]|v||i : v £ G(C)} < 2nM (max{||v|| 1 : v £ G{A)}) 2 . 

Proof. By Lemma [71 we already get 

max{||v||i : v £ G(C)} < max{||A||i : A £ 0(a T • G(A))} ■ max{||v||i : v £ Q{A)}. 

Now, observe that a T ■ G(A)) is a 1 x |^(A)|-matrix. Thus, the degree bound of primitive partition 
identities, Lemma [51 applies, which gives 

max{||A||i : A £ G(a ■ G(A))} < 2 • max{|a T v|| : v £ G{A)} - 1, 

and thus, the first claim is proved. The second claim is a trivial consequence of the first. □ 

Let us now extend this corollary to a form that we need to prove Theorem [TJ 

Corollary 9 Let A £ Z dxn and let B £ Z mx ™. Let the entries of B be bounded by M in absolute 
value. Moreover, put C := (g). Then we have 

max{||v]|i : v £ G(C)} < (2nM) 2 " 1 " 1 (nuuc{||v||i : v £ G(A)}f m . 

Proof. This claim follows by simple induction, adding one row of B at a time, and by using the 
second inequality of Corollary [5] to bound the sizes of the intermediate Graver bases in comparison 
to the Graver basis of the matrix with one row of B less. □ 

We are now ready to prove Theorem [TJ Wc start out by considering the submatrix ( ° ■ A 

main result from [5] is the following. 

Lemma 10 Let A £ Z dAXnA and B £ Z, dAXriB . There exists a number g £ Z + depending only 
on A and B but not on N such that for every N £ Z + and for every v £ G f( g °)^)> ^ e 
components of v are bounded by g in absolute value. In particular, ||v||i < (lis + NnjCjg for all 
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Combining this result with Corollary^ we get a bound for the 1-norms of the Graver basis elements 

of(g2) w 

Corollary 11 Let A G Z dAXriA , B G Z dAXnB , C G Z dcXriB , D G Z dcXriA be given matrices. 
Moreover, let M be a bound on the absolute values of the entries in C and D, and let g G Z + be 
the number from Lemma UlK Then for any N G Z + we have 

maxjllvll^ve^o < (2(n B + Nn A )Mf c ^ (max { ||v||i : v G Q (( ° A ) W ) }f° 

< (2(n B + Nn A )Mf c - 1 {{n B + Nn A )gf C . 

If A, B, C, D are fixed matrices, then max | |[v||i : v G Q A )^ N j | * s bounded by a polynomial 
in N. 

Proof. While the first claim is a direct consequence of Lemma [10] and Corollary [9] the polyno- 
mial bound for fixed matrices A, B, C, D and varying N follows immediately by observing that 
n A , n B , dc, M, g are constants as they depend only on the fixed matrices A, B, C, D. □ 

Note that the second claim of Corollary QT] is exactly Theorem [5J Now we are ready to prove our 
main theorem. 

Proof of Theorem [Q Let N e Z+, 1, u G J J nB+NriA , b G Z dc+NdA , and a separable convex 
function / : ^ nB+NnA — > R be given. To prove claim (a), observe that one can turn any integer 
solution to ? )^ N ^ z = b (which can be found in polynomial time using for example the Hermite 
normal form of \\ )^ N ^) into a feasible solution (that in addition fulfills 1 < z < u) by a sequence 

of linear integer programs (with the same problem matrix { BA ) ) that "move" the components 
of z into the direction of the given bounds, see [7]. This step is similar to phase I of the Simplex 
Method in linear programming. In order to solve these linear integer programs, it suffices (by 

the result of [T5]) to find Graver basis augmentation vectors from G (( B A ) ) for a directed 



. b A 

augmentation oracle. So, claim (b) will imply both claim (a) and claim (c). 

Let us now assume that we are given a feasible solution zo = (x, y 1; . . . , y N ) and that we wish to 
decide whether there exists another feasible solution zi with /(zi) < f(zo). By the main result 
in [11], it suffices to decide whether there exists some vector v = (x,y l7 . . . ,y N ) in the Graver 
basis of ( g ^ )^ sucri that z + v is feasible and /(z + v) < /(z ). By Corollary [TT1 and by the 
fact that n B is constant, there is only a polynomial number of candidates for the x-part of v. For 
each such candidate x, we can find a best possible choice for y l5 . . . ,y N by solving the following 
separable convex iV-fold IP: 

(x+x \ / x+x \ 

yi+yi \ / yi+yi \ 

. = b '^ : <u, yi ,..., yw eZ' 
yjv+yjv/ \yjv+y«/ 

for given Zo = (x, y 1( . . . ,y^) and x. Observe that the problem (IP)jv,b,i,u,/ does indeed simplify 
to a separable convex iV-fold IP with problem matrix ([] A ) because Zq = (x, y 1; . . . ,y N ) and 
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x are fixed. For fixed matrices A and D, however, each such AT- fold IP is solvable in polynomial 
time [8 . If the TV-fold IP is feasible and if for the resulting optimal vector v := (x, y 1; . . . , y^) we 
have /(z + v) > /(z ), then no augmenting vector can be constructed using this particular choice 
of x. If on the other hand we have /(z + v) < /(z ), then v is a desired augmenting vector for z 
and we can stop. As we solve polynomially many polynomially solvable A^-fold IPs, claim (b) and 
thus also claims (a) and (c) follow. □ 

Proof of Corollary [3l To prove Corollary[3j observe that after introducing additional variables, 
problem {IP)' N b 1 u / can be modeled as an A^-fold 4-block IP and is thus polynomial-time solvable 

by Theorcm[T] First, write the constraint z = b in (IP)' W b 1 u / as follows: 



D 



D 

A B 
D C 



B \ 



D 



( \ 



X.Y 

yi 





\ D 


... d 


C J 


Now introduce variables w x 


= E^Ll X * and W !/ 






( I 




/ / 


■ / 




-I 


/ I ■■ 






D 




C 








B 


A 






D 




C 








B 


A 






D 






c 




\ 


B 




A 



( bl \ 

bjv 



xi 

yi 



( o \ 

bi 



bjv 
biv+i 

V b 2 jv / 



Hence, (IP)^r b 1 u / can ^> e modeled as an A^-fold 4-block decomposable IP and thus, Corollary [3] 
follows by applying Theorem [1] to this transformed integer program. □ 



Acknowledgments. We wish to thank Riidiger Schultz for valuable comments on Section [2] and 
for pointing us to [5]- 
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